导航菜单
首页 >  K8s+docker +GitLab  > Installing the agent for Kubernetes

Installing the agent for Kubernetes

PrerequisitesBootstrap the agent with Flux support (recommended)Install the agent manually Create an agent configuration fileRegister the agent with GitLab Option 1: Agent connects to GitLabOption 2: GitLab connects to agent (receptive agent)Install the agent in the cluster Install the agent with Helm Customize the Helm installationUse the agent when KAS is behind a self-signed certificateUse the agent behind an HTTP proxyAdvanced installation methodInstall multiple agents in your clusterExample projectsUpdates and version compatibility Update the agent versionUninstall the agentTroubleshooting Error: failed to reconcile the GitLab AgentInstalling the agent for KubernetesTier: Free, Premium, UltimateOffering: GitLab.com, Self-managed, GitLab Dedicated

To connect a Kubernetes cluster to GitLab, you must install an agent in your cluster.

Prerequisites

Before you can install the agent in your cluster, you need:

An existing Kubernetes cluster that you can connect to from your local terminal. If you don鈥檛 have a cluster, you can create one on a cloud provider, like:Amazon Elastic Kubernetes Service (EKS)Azure Kubernetes Service (AKS)Digital OceanGoogle Kubernetes Engine (GKE)You should use Infrastructure as Code techniques for managing infrastructure resources at scale.On self-managed GitLab instances, a GitLab administrator must set up theagent server.Then it is available by default at wss://gitlab.example.com/-/kubernetes-agent/.On GitLab.com, the agent server is available at wss://kas.gitlab.com.Bootstrap the agent with Flux support (recommended)

You can install the agent by bootstrapping it with the GitLab CLI (glab) and Flux.

Prerequisites:

You have the following command-line tools installed:glabkubectlfluxYou have a local cluster connection that works with kubectl and flux.You bootstrapped Flux into the cluster with flux bootstrap.Make sure to bootstrap Flux and the agent in compatible directories. If you bootstrapped Fluxwith the --path option, you must pass the same value to the --manifest-path option of theglab cluster agent bootstrap command.

To install the agent:

Run glab cluster agent bootstrap:

glab cluster agent bootstrap

By default, the command:

Registers the agent.Configures the agent.Configures an environment with a dashboard for the agent.Creates an agent token.In the cluster, creates a Kubernetes secret with the agent token.Commits the Flux Helm resources to the Git repository.Triggers a Flux reconciliation.

For customization options, run glab cluster agent bootstrap --help. You probably want to use at least the --path option.

Install the agent manually

It takes three steps to install the agent in your cluster:

Optional. Create an agent configuration file.Register the agent with GitLab.Install the agent in your cluster.

Watch a walk-through of this process.

Create an agent configuration file

For configuration settings, the agent uses a YAML file in the GitLab project. Adding an agent configuration file is optional. You must create this file if:

You use a GitLab CI/CD workflow and want to authorize a different project or group to access the agent.You allow specific project or group members to access Kubernetes.

To create an agent configuration file:

Choose a name for your agent. The agent name follows theDNS label standard from RFC 1123. The name must:

Be unique in the project.Contain at most 63 characters.Contain only lowercase alphanumeric characters or -.Start with an alphanumeric character.End with an alphanumeric character.

In the repository, in the default branch, create an agent configuration file at:

.gitlab/agents//config.yaml

You can leave the file blank for now, and configure it later.

Register the agent with GitLabOption 1: Agent connects to GitLab

You can create a new agent record directly from the GitLab UI.The agent can be registered without creating an agent configuration file.

You must register an agent before you can install the agent in your cluster. To register an agent:

On the left sidebar, select Search or go to and find your project.If you have an agent configuration file,it must be in this project. Your cluster manifest files should also be in this project.Select Operate > Kubernetes clusters.Select Connect a cluster (agent).If you want to create a configuration with CI/CD defaults, type a name.If you already have an agent configuration file, select it from the list.Select Register an agent.

GitLab generates an access token for the agent. You need this token to install the agentin your cluster.

cautionSecurely store the agent access token. A bad actor can use this token to access source code in the agent鈥檚 configuration project, access source code in any public project on the GitLab instance, or even, under very specific conditions, obtain a Kubernetes manifest.Copy the command under Recommended installation method. You need it when you usethe one-liner installation method to install the agent in your cluster.Option 2: GitLab connects to agent (receptive agent)Tier: UltimateOffering: Self-managedHistoryIntroduced in GitLab 17.4.noteThe GitLab Agent Helm Chart release does not fully support mTLS authentication.You should authenticate with the JWT method instead.Support for mTLS is tracked inissue 64.

Receptive agents allow GitLab to integrate with Kubernetes clusters thatcannot establish a network connection to the GitLab instance, but can be connected to by GitLab.

Follow the steps in option 1 to register an agent in your cluster.Save the agent token and install command for later, but don鈥檛 install the agent yet.

Prepare an authentication method.

The GitLab-to-agent connection can be cleartext gRPC (grpc://) or encrypted gRPC (grpcs://, recommended).GitLab can authenticate to the agent in your cluster using:- A JWT token. Available in both grpc:// and grpcs:// configurations. You don鈥檛 need to generate client certificates with this method.

Add a URL configuration to the agent with the cluster agents API. If you delete the URL configuration, the receptive agent becomes an ordinary agent. You can associate a receptive agent with only one URL configuration at a time.

Install the agent into the cluster. Use the command you copied when you registered the agent, but remove the --set config.kasAddress=... parameter.

JWT token authentication example. Note the added config.receptive.enabled=true and config.api.jwt settings:

helm repo add gitlab https://charts.gitlab.iohelm repo updatehelm upgrade --install my-agent gitlab/gitlab-agent \ --namespace ns \ --create-namespace \ --set config.token=.... \ --set config.receptive.enabled=true \ --set config.api.jwtPublicKey=

It might take up to 10 minutes for GitLab to start trying to establish a connection to the new agent.

Install the agent in the cluster

GitLab recommends using Helm to install the agent.

To connect your cluster to GitLab, install the registered agentin your cluster. You can either:

Install the agent with Helm.Or, follow the advanced installation method.

If you do not know which one to choose, we recommend starting with Helm.

To install a receptive agent, follow the steps in GitLab connects to agent (receptive agent).

noteTo connect to multiple clusters, you must configure, register, and install an agent in each cluster. Make sure to give each agent a unique name.Install the agent with HelmcautionFor simplicity, the default Helm chart configuration sets up a service account for the agent with cluster-admin rights. You should not use this on production systems. To deploy to a production system, follow the instructions in Customize the Helm installation to create a service account with the minimum permissions required for your deployment and specify that during installation.

To install the agent on your cluster using Helm:

Install the Helm CLI.In your computer, open a terminal and connect to your cluster.

Run the command you copied when you registered your agent with GitLab. The command should look like:

helm repo add gitlab https://charts.gitlab.iohelm repo updatehelm upgrade --install test gitlab/gitlab-agent \--namespace gitlab-agent-test \--create-namespace \--set image.tag= \--set config.token= \--set config.kasAddress= Optional. Customize the Helm installation.If you install the agent on a production system, you should customize the Helm installation to restrict the permissions of the service account. Related customization options are described below.Customize the Helm installation

By default, the Helm installation command generated by GitLab:

Creates a namespace gitlab-agent for the deployment (--namespace gitlab-agent). You can skip creating the namespace by omitting the --create-namespace flag.Sets up a service account for the agent and assigns it the cluster-admin role. You can:Skip creating the service account by adding --set serviceAccount.create=false to the helm install command. In this case, you must set serviceAccount.name to a pre-existing service account.Customise the role assigned to the service account by adding --set rbac.useExistingRole to the helm install command. In this case, you should have a pre-created role with restricted permissions that can be used by the service account.Skip role assignment altogether by adding --set rbac.create=false to your helm install command. In this case, you must create ClusterRoleBinding manually.Creates a Secret resource for the agent鈥檚 access token. To instead bring your own secret with a token, omit the token (--set token=...) and instead use --set config.secretName=.Creates a Deployment resource for the agentk pod.

To see the full list of customizations available, see the Helm chart鈥檚 README.

Use the agent when KAS is behind a self-signed certificate

When KAS is behind a self-signed certificate,you can set the value of config.kasCaCert to the certificate. For example:

helm upgrade --install gitlab-agent gitlab/gitlab-agent \ --set-file config.kasCaCert=my-custom-ca.pem

In this example, my-custom-ca.pem is the path to a local file that containsthe CA certificate used by KAS. The certificate is automatically stored in aconfig map and mounted in the agentk pod.

If KAS is installed with the GitLab chart, and the chart is configured to providean auto-generated self-signed wildcard certificate, you can extract the CA certificate from the RELEASE-wildcard-tls-ca secret.

Use the agent behind an HTTP proxyHistoryIntroduced in GitLab 15.0, the GitLab agent Helm chart supports setting environment variables.

To configure an HTTP proxy when using the Helm chart, you can use the environment variables HTTP_PROXY, HTTPS_PROXY,and NO_PROXY. Upper and lowercase are both acceptable.

You can set these variables by using the extraEnv value, as a list of objects with keys name and value.For example, to set only the environment variable HTTPS_PROXY to the value https://example.com/proxy, you can run:

helm upgrade --install gitlab-agent gitlab/gitlab-agent \ --set extraEnv[0].name=HTTPS_PROXY \ --set extraEnv[0].value=https://example.com/proxy \ ...noteDNS rebind protection is disabled when either the HTTP_PROXY or the HTTPS_PROXY environment variable is set,and the domain DNS can鈥檛 be resolved.Advanced installation method

GitLab also provides a KPT package for the agent. This method provides greater flexibility, but is only recommended for advanced users.

Install multiple agents in your clusternoteIn most cases, you should run one agent per cluster and use the agent impersonation features (Premium and Ultimate only) to support multi-tenancy. If you must run multiple agents, we would love to hear from you about any issues you encounter. You can provide your feedback in issue 454110.

To install a second agent in your cluster, you can follow the previous steps a second time. To avoid resource name collisions within the cluster, you must either:

Use a different release name for the agent, for example, second-gitlab-agent:

helm upgrade --install second-gitlab-agent gitlab/gitlab-agent ...

Or, install the agent in a different namespace, for example, different-namespace:

helm upgrade --install gitlab-agent gitlab/gitlab-agent \ --namespace different-namespace \ ...

Because each agent in a cluster runs independently, reconciliations are triggeredby every agent with the Flux module enabled.Issue 357516 proposes to change this behavior.

As a workaround, you can:

Configure RBAC with the agent so that it only accesses the Flux resources it needs.Disable the Flux module on the agents that don鈥檛 use it.Example projects

The following example projects can help you get started with the agent.

Distinct application and manifest repository exampleAuto DevOps setup that uses the CI/CD workflowCluster management project template example that uses the CI/CD workflowUpdates and version compatibility

GitLab warns you on the agent鈥檚 list page to update the agent version installed on your cluster.

For the best experience, the version of the agent installed in your cluster should match the GitLab major and minor version. The previous and next minor versions are also supported. For example, if your GitLab version is v14.9.4 (major version 14, minor version 9), then versions v14.9.0 and v14.9.1 of the agent are ideal, but any v14.8.x or v14.10.x version of the agent is also supported. See the release page of the GitLab agent.

Update the agent versionnoteInstead of using --reuse-values, you should specify all needed values.If you use --reuse-values, you might miss new defaults or use deprecated values.To retrieve previous --set arguments, use helm get values .You can save the values to a file with helm get values gitlab-agent > agent.yaml, and pass the file to Helm with -f:helm upgrade gitlab-agent gitlab/gitlab-agent -f agent.yaml. This safely replaces the behavior of --reuse-values.

To update the agent to the latest version, you can run:

helm repo updatehelm upgrade --install gitlab-agent gitlab/gitlab-agent \ --namespace gitlab-agent

To set a specific version, you can override the image.tag value. For example, to install version v14.9.1, run:

helm upgrade gitlab-agent gitlab/gitlab-agent \ --namespace gitlab-agent \ --set image.tag=v14.9.1

The Helm chart is updated separately from the agent for Kubernetes, and might occasionally lag behind the latest version of the agent. If you run helm repo update and don鈥檛 specify an image tag, your agent runs the version specified in the chart.

To use the latest release of the agent for Kubernetes, set the image tag to match the most recent agent image.

Uninstall the agent

If you installed the agent with Helm, then you can also uninstall with Helm. For example, if the release and namespace are both called gitlab-agent, then you can uninstall the agent using the following command:

helm uninstall gitlab-agent \--namespace gitlab-agentTroubleshooting

When you install the agent for Kubernetes, you might encounter the following issues.

Error: failed to reconcile the GitLab Agent

If the glab cluster agent bootstrap command fails with the message failed to reconcile the GitLab Agent,it means glab couldn鈥檛 reconcile the agent with Flux.

This error might be because:

The Flux setup doesn鈥檛 point to the directory where glab put the Flux manifests for the agent.If you bootstrapped Flux with the --path option, you must pass the same value to the --manifest-path option of theglab cluster agent bootstrap command.Flux points to the root directory of a project without a kustomization.yaml, which causes Flux to traverse subdirectories looking for YAML files.To use the agent, you must have an agent configuration file at .gitlab/agents//config.yaml,which is not a valid Kubernetes manifest. Flux fails to apply this file, which causes an error.To resolve, you should point Flux at a subdirectory instead of the root.

相关推荐: